Reinforcement Learning Environment for Cyber-Resilient Power Distribution System
نویسندگان
چکیده
Recently, numerous data-driven approaches to control an electric grid using machine learning techniques have been investigated. Reinforcement (RL)-based provide a credible alternative conventional, optimization-based solvers especially when there is uncertainty in the environment, such as renewable generation or cyber system performance. Efficiently training agent, however, requires interactions with environment learn best policies. There are RL environments for power systems, and, similarly, communication systems. Most simulators based UNIX while Windows operating system. Hence of cyber-physical, mixed-domain has challenging. Existing co-simulation methods efficient, but resource and time intensive generate large-scale data sets agents. Hence, this work focuses on development validation OpenDSS leveraging discrete event simulator Python package, SimPy system, which agnostic. Further, we present results agents cyber-physical network reconfiguration Volt-Var problem distribution feeder.
منابع مشابه
Resilient Architectures for Integrated C2 in a Contested Cyber Environment
Public reporting burden for this collection of information is estimated to average 1 hour per response, including the time for reviewing instructions, searching data sources, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of this collection of information, including suggestio...
متن کاملResilient Cyber Ecosystems
Cyber Mission Resilience (CMR) is a significant step in the evolution of IT security. Not only does it reduce the complexity and cost of securing today’s IT systems, it helps prioritize security-related activities. The focus on mission resilience extends the scope of past security practices while simultaneously honing in on mission-critical systems, networks, and processes. This article explore...
متن کاملAn Environment Model for Nonstationary Reinforcement Learning
Reinforcement learning in nonstationary environments is generally regarded as an important and yet difficult problem. This paper partially addresses the problem by formalizing a subclass of nonsta-tionary environments. The environment model, called hidden-mode Markov decision process (HM-MDP), assumes that environmental changes are always confined to a small number of hidden modes. A mode basic...
متن کاملOFFER: Off-Environment Reinforcement Learning
Policy gradient methods have been widely applied in reinforcement learning. For reasons of safety and cost, learning is often conducted using a simulator. However, learning in simulation does not traditionally utilise the opportunity to improve learning by adjusting certain environment variables – state features that are randomly determined by the environment in a physical setting but controlla...
متن کاملReinforcement Learning Based Wide-Area Decentralized Power System Stabilizers
In this paper, the design of a real-time control framework consisting of wide-area decentralized power system stabilizers (WD-PSSs) for enhancing transient stability and oscillatory stability of power systems is investigated. The design is based on reinforcement learning methods incorporating widearea measurements. The main goal of WD-PSSs is to stabilize a power system after a disturbance lead...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2023
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2023.3282182